Memorization Weights for Instance Reweighting in Adversarial Training
نویسندگان
چکیده
Adversarial training is an effective way to defend deep neural networks (DNN) against adversarial examples. However, there are atypical samples that rare and hard learn, or even hurt DNNs' generalization performance on test data. In this paper, we propose a novel algorithm reweight the based self-supervised techniques mitigate negative effects of samples. Specifically, memory bank built record popular as prototypes calculate memorization weight for each sample, evaluating "typicalness" sample. All reweigthed proposed weights reduce Experimental results show method flexible boost state-of-the-art methods, improving both robustness standard accuracy DNNs.
منابع مشابه
Learning Instance Weights in Multi-Instance Learning
Multi-instance (MI) learning is a variant of supervised machine learning, where each learning example contains a bag of instances instead of just a single feature vector. MI learning has applications in areas such as drug activity prediction, fruit disease management and image classification. This thesis investigates the case where each instance has a weight value determining the level of influ...
متن کاملAdversarial Training for Relation Extraction
Adversarial training is a mean of regularizing classification algorithms by generating adversarial noise to the training data. We apply adversarial training in relation extraction within the multi-instance multi-label learning framework. We evaluate various neural network architectures on two different datasets. Experimental results demonstrate that adversarial training is generally effective f...
متن کاملAdversarial Training for Sketch Retrieval
Generative Adversarial Networks (GAN) can learn excellent representations for unlabelled data which have been applied to image generation and scene classification. The representations have not yet to the best of our knowledge been applied to visual search. In this paper, we show that representations learned by GANs can be applied to visual search within heritage documents that contain Merchant ...
متن کاملA Multivariate Training Technique with Event Reweighting
The performances of Artificial Neural Networks and Boosted Decision Trees using equal event weight and effective event weight training are compared in this paper. The comparison is performed in the context of the physics analysis of the ATLAS experiment at the Large Hadron Collider (LHC), which will explore the fundamental nature of matter and the basic forces that shape our universe. Based on ...
متن کاملInstance memorization and category influence: challenging the evidence for multiple systems in category learning.
A class of dual-system theories of categorization assumes a categorization system based on actively formed prototypes in addition to a separate instance memory system. It has been suggested that, because they have used poorly differentiated category structures (such as the influential "5-4" structure), studies supporting the alternative exemplar theory reveal little about the properties of the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i9.26329